Feasibility of 3D reconstructions from a single 2D diffraction measurement 
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We comment on the recent manuscript by Raines et al. |arXiv:0_905^0269V2] (now published in 
Nature, vol. 463, p. 214-217, 2010), which suggests that in certain conditions a single dilfraction 
measurement may be sufficient to reconstruct the full three-dimensional density of a scatterer. We 
show that past literature contains the tools to assess rigorously the feasibility of this approach. We 
question the formulation of the reconstruction algorithm used by the authors and we argue that 
the experimental data used as a demonstration is not suitable for this method, and thus that the 
reconstruction is not valid. 

This second version was produced for documentation purposes. In addition to the minimally 
modified original comment, it includes in appendix a subsequent reply to one of the authors (J. 
Miao). 
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This short article is a comment on the work recently 
reported by Raines, Salha, Sandberg, Jiang, Rodriguez, 
Kapteyn, Du and Miao [1| (from now on referred to as 
R09) on the extension of diffraction microscopy to three- 
dimensional densities based on a single large-scattering- 
angle measurement. The authors claim that the approach 
that they called "ankylography" allows the full recon- 
struction of the three-dimensional density of a compact 
object from a single highly oversampled diffraction mea- 
surement, thus overcoming the need of combining many 
diffraction datasets, as is typically done in tomography. 



This report aims at promoting further reflection on the 
subject. The first section covers in some details what we 
believe is a much firmer basis to assess the feasibility 
of data extension from an Ewald sphere sampling, and 
introduces some of the past literature that was unfortu- 
nately overlooked by R09. In particular, early work on 
non-uniform sampling provide valuable analytical tools 
for this problem. We also point to the close relation- 
ship between the current far-field approach and "dig- 
ital inline holography" , which can also produce three- 
dimensional information from two-dimensional measure- 
ments. Our paper also addresses what we believe are two 
important shortcomings of the manuscript: the recon- 
struction algorithm and the experimental demonstration 
of the method. 



A. Preliminaries 

In what follows, p represents the density of an isolated 
specimen and is element of L^(IR^), with D = 1, 2, or 3 
and has compact support S. 

The Fourier transform operation, denoted will be 
defined as 



f{q) - Tf{x) = 



1 



(1) 



with a straightforward generalization to higher dimen- 
sions _D > 1. 

The autocorrelation of p is defined as 



A(v)=p^p = T-^\pf 



(2) 



and has support Sa = S — S. The support of the au- 
tocorrelation extends along all axes over twice the range 
of S. For instance, in 3D if S is included in a box of 
dimensions Wx x Wy x Wz, then Sa is contained in a box 
of dimensions 2'Wx x 2'Wy x 2wz ■ 

The objective of diffraction microscopy is to recon- 
struct p(r) given the square of its Fourier transform, \p\^ . 
Because A has compact support, |p| is a band- limited 
function. In most instances, is assumed to be com- 
pletely known up to a cutoff resolution, that is, it is sam- 
pled on a grid with a spacing Aq^ finer than the Nyquist 
interval Aq^ < t^/wx (with the same relations for the sec- 
ond and third dimensions). In this context, the density p 
recovered by phase retrieval techniques was shown Q 
to be unique with a probability 1 in dimensions D > 2. 
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B. Scattering in the Born approximation 

We restrict the discussion to D — 3. Let the incident 
planar wavefront with wavenumber k propagate along the 
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z axis. The two-dimensional manifold defined by 
|q- /cz|^ 



(3) 



is called the Ewald sphere. A central result of 
the kinematic theory of scattering relates the two- 
dimensional distribution of scattered intensities to the 
three-dimensional Fourier transform of p: 



/(q^)(x|p(q)r 



Ewald 



(4) 



where q = (q±,(Zz) is the Fourier space coordinate di- 
vided in its perpendicular and parallel components, and 
the label Ewald indicates that the function is evaluated 
on the Ewald sphere (neglecting backward scattering): 



/(q) 



Ewald 



k 



qi) 



(5) 



Because / provides a partial measurement of \p\^ , the 
full three-dimensional density can be approximated with 
multiple measurements at different incident angles. This 
is the approach used in crystallography, as well as the 
prevailing technique in diffraction microscopy 043 ■ 

R09 suggest that a single intensity measurement may 
suffice to reconstruct p, even though / provides only a 
highly non-uniform sampling of |p| . 

The proposed method is similar in some aspects to 
another technique called digital inline holography Q , 
which consists of extracting three-dimensional informa- 
tion from a single near-field measurement (an inline holo- 
gram). While the measurement conditions are differ- 
ent, the depth information is fundamentally encoded in 
the same way since it is the non-negligible curvature of 
the Ewald sphere that gives a focal depth that is much 
smaller than the depth of the object. Computed propa- 
gation of the inline hologram allows determining the po- 
sition of scatterers along the propagation direction. Yet, 
what can be obtained from digital inline holography is 
rarely more than "shadows" , which are sufficient for par- 
ticle tracking applications, for instance, but are not suit- 
able for full 3D density reconstructions (see e.g. (lo|'). 



C. Non-uniform sampling 

In terms of the three-dimensional autocorrelation func- 
tion, equation ^ is 



I ^TA 



Ewald 



(6) 



where the function arguments were omitted. We now 
consider how \p\^ can be extended from the single mea- 
surement /, without additional assumptions such as the 
reality or the positivity of A and p. In principle, continua- 
tion from the Ewald sphere to R^^ is always possible, since 
/ is an analytic function. In practice however, extension 
will fail unless very strong requirements are satisfied. 



A large body of literature addresses the problem of in- 
terpolating band-limited functions, with its most famous 
probably being Shannon's 1949 work While Shan- 
non initially considered only equally spaced sampling, 
many have since worked on the more difficult question 
of non-uniform sampling. Early work by Duffin and Sha- 
effer [T^l on the subject are still being used, especially 
in the field of "super-resolution" , where multiple images 
are combined to increase resolution. Yen [ijj provided 
exact interpolating formula for important special cases. 
In 1967, Landau [Tjl showed how the Nyquist frequency 
criterion can be generalized to non-uniform sampling. 

While general results are obtained in space, much 
of the recent work on non-uniform sampling for applica- 
tions uses a finite-dimensional version of the linear equa- 
tion d^, w here the Fourier transform becomes a Fourier 
series [isl flGj (or "trigonometric polynomial" [13 )■ In 
this approach, the autocorrelation is sampled on a rect- 
angular grid and is made periodic, an approximation 
valid only if its magnitude decays sufficiently on the edge 
of the repeating box. 

Let {ri, r2, . . . , Tat} be the finite sequence resulting 
from an arbitrary labeling of the grid points belonging 
to Sa- Let in addition {qi, q2, . . . , qn} be the sequence 
of Fourier space coordinates of the measured intensity 
samples, again with an arbitrary labeling. Define two 
vectors y G M*^ and x E such that yi — I{q_i) and 
Xi = ^(r^), and let the Fourier transform operation be- 
come a, N X AI matrix 



exp(-iqi • rj) 



(7) 



Equation ^ is now cast as a finite-dimensional linear 
system: 



y = Fx. 



(8) 



The problem of recovering the three-dimensional auto- 
correlation from the intensity measurement is ill-posed 
if > M. In principle, if M > A^ and F is full-rank, 
X can be retrieved exactly. Yet, the linear system prob- 
ably has no solution because of the uncertainty in the 
measurement in /. The least-square solution is given by 



a:^is = F+y, 



(9) 



where F+ — {F'^ F) ^ is the Moore-Penrose pseudoin- 
verse of F. That F is full rank is in principle guaranteed 
as long as at least A" of the M measurement points q^ 
are different. However, as will be shown shortly, if the 
sample distribution is not uniform the matrix can have 
an effective rank much smaller than A, making the linear 
system highly ill-conditioned. 

The robustness to noise of relation © is best investi- 
gated with a singular value decomposition of _F, or equiv- 
alently by studying the eigenvalues and eigenvectors of 
F'^F. This problem was investigated in depth in the 
1960s [13, d, [3, especially for the problem of counting 
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and characterizing the degrees of freedom transmitted in 
an optical system. 

Singular value decomposition (SVD) entails factorizing 
F as 

F = USV, (10) 

where U and V are M x M and N x N unitary matri- 
ces, and S" is a non-negative M x N matrix whose only 
non-zero entries, the singular values, are along the main 
diagonal. Upon substitution in ([8]), the system becomes 
diagonal: 

y' = Sx', (11) 

where y' = U^y and x' = Vx can be seen as a change of 
basis for y and x. A zero singular value in S means that 
the corresponding entry in x' is not constrained by the 
measured data y. In practice, unconstrained degrees of 
freedom are those for which singular values are smaller 
than a threshold typically defined by uncertainty in mea- 
surements. In this sense, the number of singular values 
above the threshold plays the role of an effective rank 
for F, and the rows of V corresponding to singular val- 
ues lower than the threshold represent the effective null 
space of F. 

We illustrate the behavior of the singular value de- 
composition of F with a simple two-dimensional system. 
The two-dimensional function A has a square support 
and is reconstructed at a resolution such that its extent 
is 32 X 32 pixels, so that = 1024. Three distributions 
of measurement points were considered. In all cases, the 
number of measured samples was M = 2N, so that the 
problem is in principle well-posed. Figure [Ija) repro- 
duces the classical problem of imaging with a finite size 
pupil. All measurement points are contained within a 
disc. The singular values for this system exhibit a rela- 
tively sharp transition around an index called the "Shan- 
non number" [l^. The second case, where the positions 
have been assigned randomly, shows a very different 
singular value distribution, indicating that the interpo- 
lation is well-conditioned. The last case, shown in Fig. 
[TJe) is a two-dimensional equivalent of an Ewald sphere 
measurement with total scattering angle of 100° and in- 
cluding the Friedel pairs since A is real-valued. The cor- 
responding plot of the singular values shows clearly that 
out of the 1024 degrees of freedom in A, at most 100 can 
be determined reliably in realistic noise conditions. 

In the first and third cases, the measured domains are 
practically connected. For such cases the Shannon num- 
ber, like Weyl's formula [23|, typically scales like the vol- 
ume (or area) of the measured set, and is independent 
of the sampling density within the set, as long as it is 
higher than the Nyquist density. 

In "ankylography" , the area of the measured Ewald 
sphere portion in Fourier space is 

^Ewald ~ 27rfc^ (1 - C0s6'inax) , (12) 

where ^max is the maximum scattering angle recorded. 
To obtain a good proportionality factor, this area has to 



be expressed in units of typical "speckle size" s = tt/w, 
where w is the extent of the object's support, assumed 
to be the same in all directions. Up to a factor of order 
unity, the number of constrained degrees of freedom is 
thus 

2 

W 

iVs«8^^(l-COS0„,ax), (13) 

where \ = 2ii /k is the radiation wavelength. An approx- 
imation for small scattering angles and upper bound for 
(113 is 

7V5«47r^, (14) 

where Aa; is the pixel size in the reconstruction of p. Not 
surprisingly, the number of degrees of freedom fixed by 
one Ewald sphere measurement scales like the area of 
a section of the reconstruction rather than its volume. 
In other words, only a small fraction (roughly AttI^x/w) 
of the degrees of freedom are constrained by the mea- 
surement. Seeing Ns as an effective rank for F suggests 
that the high sampling rate imposed by the condition 
Af > is effectively meaningless as soon as noise is in- 
troduced. To illustrate this point. Fig. IJ^a) shows a 
case with M = 128. The resulting singular values, plot- 
ted in Figmjb) (full line) agree very well with the case 
M = 2048 (points), and the difference between them 
becomes relevant only when exceptionally high signal-to- 
noise ratio can be achieved. On the same figure are also 
plotted the singular values for M — 64 (dotted line) and 
M = 96 (dashed line). 

The analysis developed above focused on the problem 
of recovering the autocorrelation from the intensity mea- 
surement because the problem is linear and does not in- 
volve the additional complications of the phase recovery 
problem. Obtaining the full autocorrelation as a first step 
is a sufficient condition for the phase problem to have a 
unique solution [3], but it certainly is not a necessary 
condition, since the number of unknown in p is at least 
4 times smaller than the unknowns in A. The analysis 
is still useful even if, for instance, one assumes that the 
phases are known on the Ewald sphere, since the sam- 
pling conditions are the same when / is replaced with 
plEwaid and A is replaced with p. 

With regard to the manuscript R09, a few conclusions 
are drawn from this section. First, the theoretical tools 
to discuss the extrapolation problem are already avail- 
able. These tools are much more accurate and efficient 
than the rather vague constraint set heuristic used by 
the authors. Of course much more can be done within 
this formalism than the simple examples shown above. 
For instance, one could correlate directly the measure- 
ment noise with the threshold to compute a more accu- 
rate effective rank for F. In addition, uniqueness issues 
can be probed using the singular vectors obtained in the 
SVD calculation. These vectors form a basis on which 
an image can be decomposed to characterize the spatial 
distribution of each degree of freedom. This approach 
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FIG. 1: Examples of non-uniform samplings and the resulting singular value decompositions. In all cases, the regular 32 x 32 
grid (dots) is at the Shannon sampling density required for the real space support (not shown) to be completely determined, 
(a) Sampling limited to a disc, (c) Random sampling positions, (e) Two-dimensional equivalent of the Ewald sampling. The 

sampling points are represented by open circles. 
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is similar to the weakly constrained mode analysis devel- 
oped to describe loss of information caused by the central 
missing data in diffraction microscopy pll |. 

A second conclusion is that ankylography, as a general 
method, is doomed to failure most of the time. As il- 
lustrated by equation the data effectively provides 
only a small portion of the constraints that are required 
for the problem to be well-posed. As a consequence, in 
practical situations the "oversampling degree" condition 
Od > 1 stated in R09 is unnecessary, and can be replaced 
with M > Ns- The problem then becomes gathering suf- 
ficient additional information to ensure the uniqueness of 
the solution. Whether enough is known about the sam- 
ple in addition of the data is probably the most critical 
and most difficult question to answer. The next section 




index 

(b) 

FIG. 2: Two-dimensional Ewald sampling with lower density 
than the full-rank condition (see main text). 



addresses, among other things, these necessary comple- 
mentary constraints. 



III. RECONSTRUCTION ALGORITHM 

Retrieval of the three-dimensional density is without 
a doubt a difficult task, since it involves searching for a 
unique solution in a large phase space by ensuring that 
all known constraints are satisfied at once. In tradi- 
tional diffraction microscopy, two constraints - data in 
Fourier space and support in real space - typically suf- 
fice to determine the solution uniquely. We have shown 
above that the problem in "ankylography" needs stronger 
constraints. Apart from the support, which can be re- 
fined as the reconstruction progresses, positivity of the 
reconstructed density is probably the most important 
constraint for the success of the reconstruction. Positiv- 
ity can always be assumed unless the sample is made of 
a mixture of chemical species with very different indices 
of refractions (more precisely, for which the ratio 6/P is 
not the same). In the case of small clusters of atoms, 
it could be possible to impose an atomicity constraint, 
which can be very powerful if the resolution is sufficient. 
In Fourier space, another known constraint is the radial 
decay of the power spectrum, which helps controlling un- 
constrained degrees of freedom least correlated with the 
data, i.e. located away from the Ewald sphere region. 

Among other restraints discussed in R09 are "continu- 
ity" and "uniformity" operations. The "continuity" op- 
eration entails multiplying p with a Gaussian function. 
That it is a perturbation that favors the convergence of 
the algorithm, as claimed by the authors, may have to 
be demonstrated. Instead, the main contribution of this 
operation appears to be a control on the radial decay of 
the amplitudes. Essentially a smoothing operation, the 
operation is rather ill-named, as it pertains little to the 
mathematical definition of continuity. The "uniformity" 
operation would require more clarification from the au- 
thors. Uniformity outside the support region appears to 
be guaranteed by the support projection alone, which 
consists in setting all pixels outside the support to 0. 

Compared to other commonly used methods, the struc- 
ture of the iterative reconstruction algorithm presented 
in R09 is difficult to interpret. It is defined as multi- 
ple nested loops where various operations are applied in 
turn. Unlike most commonly used iterative algorithms 
[23 - l2^ . many of the operations are not projections onto 
constraint sets. The projections formalism, also widely 
used in convex optimization problems (25l . [26| , allows a 
precise characterization of the reconstruction dynamics, 
and helps interpreting the outcome of a reconstruction. 
Using projections, an iterative algorithm is not merely 
a "recipe that happens to work well". One of the re- 
quirements for an operation to be a projection is idem- 
potency: applying a projection twice is the same as ap- 
plying it once. It is this characteristic that is missing in 
the "continuity" and "uniformity" operations. As a re- 
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suit, the frequency at which they are appUed affects the 
final solution. If, for instance, the Gaussian multiplica- 
tion is applied more often, its effect will accumulate and 
the high spatial frequency amplitudes are expected to be 
smaller. Questions such as: how often should this oper- 
ation be applied? how is "convergence" defined? How 
is "solution" defined? remain widely unanswered. The 
seemingly ad hoc succession of operations makes very dif- 
ficult the identification of the algorithm's strengths and 
weaknesses. 



IV. A FLAWED EXPERIMENTAL 
DEMONSTRATION 

We complete this report with a discussion on the re- 
construction of experimental data presented in R09. A 
diffraction pattern was measured using an extreme ultra- 
violet (EUV) laser source (A = 47 nm). The sample was a 
figure etched through a 100 nm silicon nitride membrane. 
At this wavelength, the transmission of the membrane is 
negligible. The diffraction pattern was collected with a 
CCD placed near the sample to collect scattering out to 
a large angle. In R09, Figure 4 shows an isosurface ren- 
dering of the three-dimensional reconstruction obtained 
from this single diffraction pattern. 

It may seem odd at first that the reconstructed density 
is really that of a hole in a membrane. What is the physi- 
cal origin of the front and back faces of the reconstruction 
if the sample was in reality an empty region sandwiched 
between nothing? That such a measurement is in princi- 
ple possible is a consequence of a three-dimensional ver- 
sion of Babinet principle. It suffices to express the three- 
dimensional density of the etched membrane as the dif- 
ference between a uniform slab and the density of the 
material that would form the figure in the hollow mask: 
Pmask = /Osiab " Pfiguro- After taking the Fourier trans- 
form on both sides of this equation, one observes that the 
slab term has its power concentrated on a single line per- 
pendicular to the slab surface (a truncation rod), which 
intersects the Ewald sphere only at the origin. Therefore 
at the exception of the very center of the diffraction pat- 
tern, the scattering from the mask is exactly equal to the 
scattering from an isolated absorbing figure having the 
same shape as the hole. 

This explanation however is not applicable to the re- 
construction presented in R09, because the absorption 
of the membrane is very large, and thus the Born ap- 
proximation is not valid. Consequently, apart from even- 
tual dynamical scattering along the edges of the hole, 
no information on the thickness of the membrane can 
be transmitted to the detector. Figure [3] shows diffrac- 
tion patterns obtained by multislice simulations of the 
same mask but with different scattering strengths. The 
weakly scattering membrane in Fig [3ja) yields charac- 
teristic dark rings that are readily interpreted as the in- 
tersection of the Ewald sphere with the zeros of the sine 
function from the Fourier transform of the slab density. 




(b) 

FIG. 3: Multislice simulation of the diffraction from a mask 
etched in a membrane tilted by 5° relative to the incoming 
plane wave, (a) Weakly scattering object. The membrane 
transmits 100% of the wave and causes a phase shift of 
about 0.027r. (b) Strong object. The transmission of the 
membrane is .03%. 



In the present case the rings are off-center because the 
membrane was tilted by an angle of 5° to reproduce the 
experimental conditions of R09. The rings are absent in 
Fig. [S^b), which shows the strongly absorbing case. 

Strong absorption is not compatible with the single- 
scattering view of Ewald sphere sampling. The recon- 
struction presented in R09 is therefore not valid. That 
the overall tilt of the membrane could be reconstructed 
should not come as a surprise, as this information is 
recorded in the distortion of the diffraction pattern on 
the flat detector. It appears that the reconstruction pre- 
sented in R09 is in reality a tilted 2D reconstruction, in 
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which the depth of the flat sample is just an artifact - 
an extrusion of the two-dimensional map. A good exper- 
imental proof of ankylography would have been to pro- 
duce two weak objects placed a suitable distance apart 
in the propagation direction. 

V. CONCLUSION 

The main conclusions of this "open review" of Raines 
et al. [H are: (1) Although valid in principle, ankylog- 
raphy will probably succeed only in special cases where 



high-quality data and strong additional constraints are 
available; (2) The description and the properties of the 
iterative reconstruction method may not meet the stan- 
dards of state-of-the-art algorithms in the field; (3) The 
experimental demonstration is not valid because the sam- 
ple docs not satisfy the Born approximation. 
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Appendix A: Open letter in reply to the authors' reply 



This letter was originally made available at the address 

http : //people .web . psi . ch/thibault /current /lett er_t o_John_Miao .pdf. 



John Miao 

Department of Physics and Astronomy 
UCLA 



Pierre Thibault 
Department of physics 
Technical University of Munich 



Dear John, 



Here is my short answer to the response you produced 27] about my commentary article [28[ on "ankylography" 
I thank you for taking the time of preparing this answer. It will certainly be useful to make my manuscript clearer 
in the next version. I was nevertheless disappointed to see that you dismissed all of my criticisms. I feel that many 
of my points were misunderstood and some even misrepresented. 



You seemed to refuse to consider most of my theoretical derivation for two main reasons: (1) that phase retrieval 
can be possible even if the intensity measurement is partly aliased and (2) that additional real-space constraints are 
necessary. 

First, I want to say that I agree with these statements and that a rectification is in order. Regarding (1), you said 
"Thibault implied the requirement of obtaining the autocorrelation function for phase retrieval of coherent diffraction 
intensities, which was the basis of his theoretical analysis" (page 2). Still, I thought that I made clear that I was 
aware of this fact by saying that "obtaining the full autocorrelation as a first step is a sufficient condition for the 
phase problem to have a unique solution, but it certainly is not a necessary condition" (page 9). 

As for (2), you wrote that my analysis is "flawed" because I have "ignored the vital importance of the various 
physical constraints" (page 7). Yet, I wrote that "the data effectively provide only a small portion of the constraints 
that are required for the problem to be well-posed [...] The problem then becomes gathering sufficient additional 
information to ensure the uniqueness of the solution. Whether enough is known about the sample in addition of the 
data is probably the most critical and most difficult question to answer" (page 9). 

More important is the fact that these two statements do not affect the results of my analysis. The goal of the 
section about non-uniform sampling was to describe and quantify how much, or how little, information on the object 
is provided by the intensity measurement. I obtained an expression for the rough number of degrees of freedom fixed 
by the data alone, and specified, as quoted above, that additional degrees of freedom would need to be restrained 
with real-spaced constraints. 

I found your argument about the autocorrelation very puzzling. Even though it is true that some degree of aliasing 
still permits reconstructions, this is hardly relevant in the present discussion since we are free to choose the sampling 
of the intensity, and there is no good reason to pick a sampling density that is lower than the Nyquist criterion. All 
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simulations in your paper certainly were far away from the lower end of the possible sampling density, as is the Figure 
1 in your response. Note also (looking at Figure 1 below) that the situation of a lower sampling density can just as 
well be described in the formalism I described in my comment. 

This freedom of choosing the sampling density is a direct consequence of Shannon's theorem: if Nyquist criterion 
is satisfied, the signal is completely determined by its samples. In your paper and in Figure 1 of your response, you 
chose a sampling substantially higher than the Nyquist criterion. Still, I want to emphasize that any sampling that 
is denser than Nyquist's criterion is redundant and contains no new information. Keeping this fact in mind, I hope 
that you now see how the Figure 1 in your response is completely equivalent to my Figure 1(e), the only difference 
being that I picked the coarsest sampling allowed by the Nyquist criterion. That's what I meant in the caption by 
"the regular 32 x 32 grid (dots) is at the Shannon sampling density required for the real space support (not shown) 
to be completely determined." . 

Looking carefully at your response, I sense that the main source of misunderstanding is about a quite fundamental 
question, namely how to count the constraints and the degrees of freedom in diffraction microscopy in general. It 
used to be thought that the oversampling ratio, 

number of intensity measurements 
number of independent pixels in the support ' 

is the right way of measuring how overconstrained is a problem. This definition seems intuitive: for a given object 

size, the more individual intensity measurements, the more the system is constrained. But is it not completely correct. 
As mentioned above. Shannon's theorem says that sampling a signal at a higher frequency than the Nyquist criterion 
adds no information. So it is not correct to say that an intensity measurement with a = 20 contains twice as much 
information as the measurement with cr = 10 since, beyond Nyquist frequency, any additional sample depends linearly 
on the other samples. It turns out that the real number of constraints in the problem is not the number of intensity 
measurements, but rather the number of independent pixels in the autocorrelation support (normally 1/2 the total 
number of pixels in the autocorrelation support because it is always centrosymmetric). This leads to the definition of 
a more meaningful ratio: 

^ number of independent pixels in the autocorrelation support f A21 

number of independent pixels in the support 
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(a) 



(b) 



FIG. 4: (a) Representation of a sampling density lower (circles, 24 x 24) than that required by Nyquist criterion (dots, 
32 X 32). (b) Singular values resulting from the SVD calculation on this system. All singular values are large but the system 

has only 24^ = 576 fixed degrees of freedom. Taking into account the centrosymmetry of the autocorrelation, the actual 
number of independent degrees of freeedom fixed by the measurement is 288, which should still make phase retrieval possible 
as the object has 16^ = 256 independent pixels (f2 = 288/256 > 1 or equivalently in this situation a = 576/256 > 2). 
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The requirement for reconstructibility is J7 > 1. I invite you to take a look at the recent paper by Elser and MiUane 
[2^ . where the properties of this "constraint ratio" are explored in details. Note that becomes equal to a/2 in 
the case where the autocorrelation starts to "wrap around" because of a lower sampling rate. This situation is 
illustrated in Fig. 1 above. In the case depicted, all singular values of the matrix F are large enough for the system 
to be invertible. Still the rank of F, and thus the number of fixed degrees of freedom, is limited by the number of 
intensity measurements. At this lower end of the sampling density, a becomes a good measure of how difficult is 
a reconstruction, as you, David Sayre and Henry Chapman have shown a little while ago Yet, in pretty much 
all practical cases, the sampling of the intensity satisfies the Nyquist criterion. Sampling on a finer grid has clear 
experimental benefits, as a way of increasing the dynamic range and reducing the effect of the detector point spread 
function. But it does not make solving the phase problem fundamentally easier. 

To summarize: the maximum number of degrees of freedom that can be fixed by the data is the number of 
independent pixels in the autocorrelation. The point of my analysis was to find what proportion of these degrees of 
freedom was effectively fixed by a single Ewald sphere measurement. What I wanted to show is 

1. that there is a formal way to describe why ankylography is possible in principle, since I was unsatisfied with 
the set-theoretic argument used in your paper. Saying that "the intensity points encode information from all 
possible orientations of a 3D object" says very little on whether this information is sufficient, or if it can be 
extracted. 

2. that in practice, the problem is highly ill-conditioned, so that the condition Od > 1 is not relevant to realistic 
datasets, and that the Shannon number is a better measure than the number of intensity measurements to 
estimate the number of degrees of freedom fixed by the data. 



I will not dwell too long on my criticism of your algorithm. I just want to point out that the "projection formalism" 
to which I was referring is much more general than you implied. I was of course not advocating the use of ER 
instead of HIO. What I meant is that all of the most widely used algorithms (error reduction, hybrid input output, 
difference map and relaxed averaged alternating reflections) can be express in this formalism, which is very convenient 
to understand their dynamics |30|]- 



Your response regarding the experimental demonstration is certainly the part with which I disagree the most. I 
must not have been clear enough. 

First, I should mention that the second paragraph about the "3D Babinet" principle was little more than a peda- 
gogical step, a mere preparation for my argument. I wanted first to answer an eventual question about the physical 
significance of the recovered 3D density. In a very simple-minded approach, one could ask: "this etched figure is just 
an empty hole, how can you reconstruct the density of a hole, and if you do, what is its meaning? It certainly is not 
an electron density." To this hypothetical question, I answered that if the Born approximation is valid, one can see it 
as the negative of the slab density, since a uniform slab affects only the very center of the diffraction pattern. Calling 
the density subtraction a "3D Babinet" principle may have been misleading, but it does follow the same reasoning 
as in the 2D case. Now, I want to reiterate that the only goal of this paragraph was to establish that in the Born 
approximation this interpretation holds, and that doing such a reconstruction is meaningful, even quantitatively. 

I certainly "realized that taking the Fourier transform on both sides requires [...] the Born approximation" (page 
9), as implied by the beginning of the next paragraph, where I stated that "this explanation however is not applicable 
to the reconstruction presented in R09, because the absorption of the membrane is very large, and thus the Born 
approximation is not valid." This is the essence of my argument, which I would certainly not call "self-contradictory" . 
By mapping the measured intensities on the Ewald sphere, ankylography relies on the Born approximation [this is 
the condition for equation (4) in my comment to be valid]. But a strongly absorbing sample does not satisfy Born 
approximation. Therefore it is wrong to interpret the measured intensities as a spherical section of the squared 3D 
Fourier transform of the density. In your reconstruction, the 3D array in which the measured intensities are distributed 
has no physical interpretation: it certainly is not the Fourier transform of the 3D electron density (or refractive index 
map) of the slab since this requires the Born approximation to be valid. 

I don't know why you so hastily dismissed my numerical simulations as invalid. These are multislice simulations in 
which I did not do any assumption about a "Babinet" principle (obviously it would have been wrong, as you pointed 
out). I don't know exactly on what is based your judgment that Fig. 3(b) "doesnt look like a Fraunhofer diffraction 
pattern at all" , since that is exactly what it is: the free-space propagation to infinity of the exit wave generated by 
a multislice simulation of a wave passing through an aperture in a slab with total transmition of 3 x 10~^. The slab 
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was even tilted by 5°. The slow modulation of the intensity, reminiscent of the rings in Fig. 3a probably is the effect 
of the dynamical scattering of the edge (such as the point P3 in your figure) which the multislice simulation does take 
into account. The main point of Figure 3 was to show the dark rings in Fig. 3(a), which are the signature of the 
validity of Born approximation which (let me repeat it again) is a prerequisite for ankylography to work. 

You say that "it can be easily shown by using the diffraction theory that, when the edge effect is negligible, the 
measured intensities arc proportional to the square of the Fourier transform of the 3D sample on the Ewald sphere" 
(page 10). I don't think this is true and I would be glad to see your proof of that. What I contend instead is that the 
valid way of treating an absorbing mask is by assuming that it is a two-dimensional object - it may be a tilted planar 
object, but still only planar. I can provide a detailed derivation if you want. This is what led me to conclude that 
apart from the tilt, which can be extracted from the data, the rest is only an artificial extrusion of a 2D amplitude. 
I am also ready to debate your affirmation that the "structure defects would be invisible in the 2D reconstructed 
image" (page 11), and would certainly be happy to look into your diffraction data to prove my point. 



As I said above, I am sorry that you rejected all of my criticisms, and I hope to be able to discuss furthcir any of 
them with you soon. I will also check the validity of my claims through the peer review process by submitting soon 
an improved version of my arXiv comment for publication. 



Best regards. 



Pierre 
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